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© A multi-processor graphics system including a 
general purpose system control processor for setting 
up the workstation environment and data traversal 
structures based upon an application model lan- 
guage description. Workload balancing and inter- 
processor communication is managed by defining a 
general purpose interface between the general pur- 
pose processor and special purpose graphics control 
processor. The system control processor accepts 
application program information in a standard form, 
such as a hierarchical graphics language definition, 
then converts it into generalized interface control 
blocks for communication to the graphics control 
processor. Graphics control processor is signalled 
by an interrupt from the system control processor to 
begin the traversal process. The graphics control 
processor can then access the standard control 
blocks contained in system memory and perform the 
traversal necessary to generate the requested graph- 
ics image. Generalized control blocks allow rapid 
adaptation to program changes and efficient commu- 
nication between the general purpose and special- 
ized processors. 
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GRAPHICS DISPLAY SYSTEM 



This invention relates to graphics display sys- 
tems for displaying graphics objects defined by a 
hierarchical structure of graphics display elements. 

Graphics display systems used in the area of 
computer aided design (CAD), and computer aided 
engineering (CAE) display images created based 
upon graphics orders entered into the system. The 
graphics orders define objects in terms of primitive 
drawing operations for line, point, polygon, and 
similar primitive structures. Complex graphical im- 
ages can be represented as a combination of these 
graphical primitives. Modern graphics display sys- 
tems implement hierarchical representations of 
data that allow a single low level structure definition 
or sequence of structure definitions to be repet- 
itively used to express an object. Thus, for exam- 
ple, a primitive definition of a single wheel may be 
entered, and then used repetitively to define the 
wheels of an automobile on a computer-aided de- 
sign application. One of the emerging standards for 
graphics system programming is known as the 
Programmer's Hierarchical Interactive Graphics 
System (PHIGS) that provides a set of functions for 
the definition, display, and manipulation of graphi- 
cal data and geometrically related objects. 

An interface standard such as PHIGS allows a 
particular graphics application program to be writ- 
ten at a high level without concern for the detailed 
implementation in a particular graphics display sys- 
tem. The use of this higher level language allows 
applications programs to be transferred between 
various types of equipment with only minor modi- 
fication. 

The logical data flow of a system employing 
hierarchical data structure is presented in Fig. 1. 
User application program 100 passes the data 
stream 102 containing necessary graphics informa- 
tion to the graphics processing system. The data 
stream information is divided into two functional 
categories: structure storage 104 containing the 
detailed descriptions of the graphics elements to 
be displayed; and the workstation state list 106 
containing information necessary to set workstation 
variables to the appropriate value. A workstation 
program operating on the structure storage and 
workstation state list produces the final image to be 
generated on display surface 108. 

A hardware architecture for implementing this 
form of graphics display system is shown in Fig. 2. 
Communications processor 110 provjdes an inter- 
face to. a host system containing graphics orders 
and potentially, the user application program and 
graphical database. System control processor 112 
manages the geometric database and controls the 
overall operation of the graphics display system. 



System control processor 112 is a general purpose 
processor that can perform a variety of tasks. 
Graphics command processor 114 interprets the 
graphics commands placed in system memory by 
5 the system control processor and generates the 
detailed commands required by display processor 
116, associated geometric processing unit 118 and 
rendering unit 120 that perform the actual object 
drawing. The final outputs of the display processor 
10 are pixel definition signals sent on line 122 to the 
frame buffer for display on a display device. 

The functional structure of a multi-processor 
computer graphics display system is discussed in 
J. D. Foley and A. Van Dam Fundamentals of 
75 Interactive Computer Graphics , Addi son-Wesley 
Publishing Company, 1982 on pp. 406-410 and 
424-428. Other implementations of multi-processor 
graphics systems include U.S. Patent 4,862,392, 
"Geometry Processor for Graphics Display Sys- 
20 tern" to Steiner. 

The model presented by Foley and Van Dam 
shows a display file compiler as part of the applica- 
tion program that contains a model traverser to 
map the application model (AM) to the structure 
25 display file containing a hierarchical description of 
the graphical representation of the object. The hier- 
archical display file is then processed by the dis- 
play processing unit to create graphical primitive 
orders (linear display file) necessary to generate 
30 the object in the display controller. The display file 
compiler (DFC) according to Foley and Van Dam is 
specialized as part of the application package. This 
leads to certain inefficiencies due to the need to 
create a separate display file compiler for each 
35 application or each graphics display system. The 
introduction of standardized interface formats such 
as PHIGS allows the introduction of standardized 
display file compilers which convert an application 
model created in, for example, the PHIGS structure 
40 to the structure display file format. This display file 
translation typically requires significant processor 
resources and tends to become a bottleneck in the 
graphics display systems. 

Steiner illustrates a multiprocessor system with ^ 
45 a specified processor for geometry processing. 
Steiner illustrates the advantages of the multi-pro- 
cessor system but does not address the problem * 
of the display file compiler bottleneck conversion of 
the application model to structured display file for- 
50 mat. 

The display file compiler has two primary func- 
tions. First, the DFC must establish the physical 
graphics display system environment ordered by 
the application graphics instructions. This typically 
involves establishing workstation parameters and 
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creating workstation default profiles. The second 
function involves processing or traversing of the 
graphics orders to generate the detailed description 
of the object necessary for geometry processing 
and rendering by subsequent processors. This tra- 
versal occurs within the defined workstation envi- 
ronment and is dependent upon the established 
environment The inter-relationship of the worksta- 
tion environment and model traversal has dictated 
that these be accomplished in the same logical 
processor. However, processor speed limitation has 
caused the single display file compiler logical pro- 
cessor to become a bottleneck in graphics display 
systems. 

In accordance with a first aspect of the inven- 
tion, there is provided a graphics display system 
for displaying graphics objects defined by a hierar- 
chical data structure, said system comprising: 
first processor means for transforming said hierar- 
chical data structure into a first set of control in- 
formation defining a workstation environment and a 
second set of control information defining a data 
traversal process; 

second processor means responsive to said first 
processor means for traversing said second set of 
control information for generating graphics orders 
based on said first and second sets of control 
information; 

and means for displaying said graphics objects in 
response to said graphics orders. 

A graphics display system in accordance with 
the present invention has, therefore, an architecture 
that divides the display file compilation function 
into separate logical processes. 

Preferably a general purpose system control 
processor establishes an environment in response 
to an application model and controls the model 
traversal and display generation processes, and a 
second special purpose graphics processor per- 
forms model traversal to generate a structure dis- 
play file for further geometric processing and ren- 
dering. 

The invention thus enables a balancing of the 
workload between the general purpose and special 
purpose graphics processors. 

In accordance with a second aspect of the 
invention there is provided a method, in a graphics 
display system, for traversing a hierarchical data 
structure defining graphics objects to generate a 
display of the graphics objects, the method com- 
prising the steps of: 

separating, by means of a first processor, said 
hierarchical data structure into a first set of work- 
station control information and a second set of 
traversal control information; . 
signalling the beginning of data structure traversal; 
and 

traversing, by means of a second processor, said 



second set of control information and generating 
graphics orders based on said first and second 
sets of control information, said graphics orders 
being transmitted to means for displaying said 
s graphics objects. 

A particular embodiment of the present inven- 
tion is described hereinafter with reference to the 
accompanying drawing in which: 

Fig. 1 is a data flow diagram illustrating the 
w types of data processed by a multi-processor 
graphics system according to the present inven- 
tion. 

Fig. 2 is a block diagram of the processing 
elements of the graphics display system accord- 

75 ing to the present invention. 

Fig. 3 is an illustration of the linking between the 
elements of the graphics structure. 
Fig. 4 is an illustration of the memory organiza- 
tion and linkage employed in the general pur- 

20 pose interface. 

Fig. 5 is an example of the layout of an edit 
group format 

Fig. 6 is an illustration of the flow of control 
between graphics structures. 
25 Fig. 7 is an illustration of the memory organiza- 
tion and inter-relationships of structure groups. 
Fig. 8 is a flowchart illustrating the flow of con- 
trol in a traversal operation in the graphics con- 
trol processor according to the present inven- 
30 tion. 

Fig. 2 presents a multi-processor display sys- 
tem according to the present invention. A commu- 
nications processor 110 communicates with the 
host computer through a channel connection or 
35 network. The communications processor receives 
outbound data from a user program in the host and 
sends the data to system control processor 112 for 
processing. The data transmitted is typically an 
application model using a standard interface de- 
40 scription such as PHIGS. Any inbound data gen- 
erated in the workstation will be sent to the host 
computer through the communications processor. 

System control processor (SCP) 112 controls 
the data flow of the system. The system control 
45 processor analyzes the application model data to 
generate a workstation state fist describing the re- 
quired processing environment and structure stor- 
age containing the hierarchical model description in 
the system memory. The SCP controls the graph- 
so ics control processor execution to draw the geo- 
metric images from structure storage based upon 
user program commands. 

System memory 113 stores the workstation 
state list and structure storage created by the sys- 
55 tern control processor 112. System memory 113 is 
also accessible by the graphics command proces- 
sor and is used during the graphics drawing pro- 
cess. 
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Graphics command processor (GCP) 114 tra- 
verses the graphics model stored in system mem- 
ory 113 and processes instructions to generate and 
pass geometric processing orders to the display 
processor for geometric processing and primitive 
rendering. 

Display processor 116 consists of two compo- 
nents: geometry processing unit 118 which per- 
forms transformation, clipping and mapping of geo- 
metric primitives, including light model calculation 
for shading, and rendering unit 120 that renders 
primitives including line drawing, polygon filling and 
shading and hidden line and hidden surface re- 
moval. The output of the display processor is a 
series of pixels that are passed to the frame buffer 
for eventual display on the display device. 

The primary function of the system control 
processor 112 is to process the application model 
data stream transmitted from the host computer 
through communication processor 110. The system 
control processor 112 forms the data into specified 
control blocks which are used to communicate with 
the graphics control processor 114. SCP process- 
ing is designed to reduce GCP workload by split- 
ting workstation environment determination 
(performed by the SCP) from model traversal 
(performed by the GCP). The control blocks are 
built by the system control processor and stored in 
the system memory 113. The control blocks in- 
clude: 

Workstation State List (WSL) - system control pro- 
cessor to graphics control processor communica- 
tion block 

Structure Storage (SS) 

- traversal control block 

- view tables 

- view addressing table 

- root blocks 

- edit blocks 

The workstation state list contains data descrip- 
tions and drawing information required by the work- 
station to process the application model. This table 
is initialized at system startup and may be modified 
by certain procedural orders. Drawing control ta- 
bles contain the information required by the graph- 
ics control processor for model traversal and pic- 
ture drawing. The workstation state list contains the 
graphics interface output flags, view table settings, 
bundle table settings, other table settings, filter 
tables, pointers to the various work areas, and 
character set identifications. Current control tables 
contain the pointers to default line style and marker 
type and hatch areas, input device locators, mis- 
cellaneous fields, pointers to current traversal 
block, and content of the request traversal block. 

The traversal control block contains a list of 
view masks. These masks are used to keep track 
of the different changes made to each view. The 



offset of a bit into the mask correlates to the index 
of the view. The offset is measured starting from 
the leftmost bit of the mask field, thus, the view 0 
is at offset 0 of the mask which correlates to the 
5 leftmost bit. At graphics interface initialization all 
views are inactive except view 0. Each view be- 
comes active when a "set view characteristic" or- 
der for that view is processed by the system con- 
trol processor. Each time the graphics control pro- 
10 cessor 114 has completed traversing a view, it sets 
the corresponding table entry to 1. When the 
graphics control processor finishes the traversal of 
all active views it interrupts the system control 
processor 112 which then replaces all table entries 
75 with 0. This communication table between the 
graphics control processor and system control pro- 
cessor allows the graphics control processor to 
avoid redrawing already completed low priority 
views when temporarily interrupted by the system 
20 control processor. 

The view table contains the characteristic in- 
formation of an individual view. All view tables are 
chained to each other according to priorities. When 
a view is first created, its content is set to a default 
25 content of the view 0. Contents of all view tables, 
except for view 0, may be later modified by proce- 
dural orders. An example of the chaining of views 
to structure blocks and groups is shown in Fig. 3. 
The view addressing table contains pointers to 
30 the requested view table addresses, the current 
view table addresses, and the output view priority 
table. These tables, among other things, specify 
the requested views and the currently active views. 
The current input view priority table, request input 
35 view priority table, and current input view priority 
table are all similar to the output view priority table 
and indicate the order of view processing during 
respective operations. 

For each root connected to a view there exists 
40 a corresponding root block. All roots connected to 
a particular view are connected according to their 
priorities in the view. The lowest priority root is 
always connected first proceeding to the higher 
priority views. 

45 The edit block list is made up of one or more 

variably sized edit blocks. Each edit block contains 
portions of the attribute or primitive structure ele- 
ment for a graphic display. The structure elements 
in the edit block are arranged in order according to 

so the appearance in the structure. Blocks are con- 
nected to each other through doubly linked point- 
ers. 

Structure elements are the smallest units in the 
display 'data structure: A structure element could 
55 be -an output primitive such as a polyline, or an 
attribute such as color, associated with the output 
primitive. A partial list of structures in a standard 
interface such as PHIGS includes: 
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1. bundled attribute selection elements 

2. individual attribute selection elements 

3. insert application data 

4. execute structure 

5. insert label 

6. set pick identifier 

7. set attribute source flag 

8. modelling transformation elements 

9. output primitive elements. 

The general purpose interface according to the 
preferred embodiment of the present invention sup- 
ports a total of five bundle tables each having a 
maximum of 20 entries. The user application may 
direct certain tables to be established at interface 
initialization. The general interface then allocates 
consecutive storage locations for specified bundle 
tables. Each bundle entry corresponds to one bun- 
dle index and entries are arranged in consecutive 
order. The following types of bundle tables are 
supported, 
polyline bundle table 
polymarker bundle table 
text bundle table 
interior bundle table 
edge bundle table 
pattern bundle table 
hatch bundle table. 

Additional tables include: 
the hatch table 
the depth queue table 
the cull size table 
the color processing mode table 
the light source table 
the active character set table 
the line type table 
the marker type table 
the hardware color table 
logic color table 
class name table 
filter bit table. 

The class name table and filter bit table to- 
gether contain the filter table information for high- 
lighting, picking and invisibility filters. Both tables 
contain 1,024 entries in the preferred embodiment. 
When a class name is requested to be added to 
the pick inclusion filter, the GCP will insert the 
class name into the proper entry in the class name 
table and sort the class name table. The GCP then 
activates the pick inclusion bit in the corresponding 
index and entry into the filter bit table. If the class 
name is requested to be added to both the pick 
inclusion filter and highlighting exclusion filter, the 
general interface first inserts the specified class 
name into the proper entry in the class name table 
and then activates the corresponding bits for pick 
inclusion and highlight exclusion. 

The workstation viewport is a portion of the 
display surface where the output images will be 



shown. The workstation window is a square or 
rectangular parallelepiped of which the boundary 
and interior will be mapped into the workstation 
viewport while preserving the aspect ratio in X and 

5 Y but not necessarily in Z. The general interface 
uses this information together with the viewport, as 
set by the application, to calculate the device 
viewport and store the resulting information in the 
view table. The workstation window viewport is 

w stored in the workstation state list for the inquiry 
function. 

The system control processor 112 and the 
graphics control processor 114 communicate 
through interrupts and the communication areas 

75 described, above which are stored in the system 
memory 113. The system control processor will 
first initialize graphics control processor 114 
through general interface initialization. This initial- 
ization includes establishment of all interface con- 

20 trol blocks. The SCP may next interrupt the graphic 
control processor to start traversal and may later 
stop traversal. 

The graphics control processor may interrupt 
the system control processor to signal that initial- 

25 ization is complete, traversal is complete, a stop 
traversal request is complete, or an error has oc- 
curred. 

The actions which occur on each of these 
interrupts will now be described. Fig. 4 is used to 

30 describe the process. Graphics control processor 
initialization begins when the system control pro- 
cessor interrupts the graphics control processor 
When the reason code passed by the interrupt is 
"initialization" graphics control processor 114 reads 

35 data from the workstation state list 130 in order to 
initialize the graphics control processor. The GCP 
maintains a pointer 128 to the shared area of 
system memory used for communication with the 
SCP. 

40 Graphics control processor traversal is initiated 

by an SCP interrupt. If the interrupt reason code is 
"draw geometric data" then the traversal process 
begins. The graphics control processor begins by 
fetching the first word in the traversal control table 

45 132 and checks each resource. The GCP next 
fetches the index of the view to be drawn first in 
the traversal control table. The GCP finds the point- 
er to the starting view in the view addressing table 
134 and begins processing the data fetched from 

so the view table 136. Processing of the view table 
continues by accessing the pointers to the first root 
block in the view table and continues by process- 
ing the root structure to access the first addressed 
edit group. The structure of an edit group is shown 

55 in Fig. 5. 

If an "execute structure" is encountered in the 
edit group, the graphics control processor will use 
the pointer to an entry in the "execute structure" 
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first edit group address table and will locate a 
pointer to the first edit group associated with that 
structure (Figs. 6 and 7). 

The graphics control processor will continue to 
operate in this manner until it reaches the end of a 
root structure when it will test to determine whether 
additional root blocks exist. At the completion of all 
root block traversals, the graphics control proces- 
sor tests for additional views. When the last view 
has been completely traversed, the graphics con- 
trol processor causes the frame buffers to be 
swapped. In a system with a double frame buffer, 
under certain conditions the graphics control pro- 
cessor copies the display contents of the first 
frame buffer to the background frame buffer. 
Graphics control processor then interrupts the sys- 
tem control processor to signal the finishing of the 
drawing of one frame using the interrupt. Fig. 8 
illustrates the overall flow of the graphics control 
processor. 

There has been described, a method for tra- 
versing a hierarchical data structure to generate a 
graphics display comprising the steps of: 
separating said hierarchical data structures into a 
first set of workstation control information and a 
second set of traversal control information; 
signalling the beginning of data structure traversal; 
and 

traversing said second set of traversal control in- 
formation and generating graphics drawing orders 
based on said first and second sets of control 
information, transmitting said graphics drawing or- 
ders to a display processor for generation of a 
display image signalling traversal completion. 

Said first set of workstation control information 
comprises workstation flags, view table indicators, 
bundle table settings, pattern table settings, filter 
table settings, input device descriptions, traversal 
process status flags, and said second set of tra- 
versal control information comprises descriptions of 
views, structures, and edit blocks. Said method 
further comprises the steps of: 
accessing said first set of control information to 
determine a view table to begin traversal process- 
ing 

testing said description of views associated with 
said view table to determine whether to begin tra- 
versing said view and accessing a subsequent view 
if traversing for said view has been completed; 
modifying said description of views as traversal of 
each view is completed to indicate completed tra- 
versal; and 

modifying said description of views after all views 
have been completed to reset an indicator to in- 
dicate traversal is required. 

The method further comprising the steps of: 
interrupting said traversing; 

modifying said first or second set of information; 



and 

resuming said traversing after testing said first set 
of control information so that any modified view is 
retraversed and any unmodified view is not re- 

s traversed. 

There has also been described a graphics dis- 
play system for displaying graphics objects de- 
scribed as a hierarchical data structure, said sys- 
tem comprising: 

w first processor means for transforming said hierar- 
chical data structure into a first set of control in- 
formation describing a workstation environment and 
a second set of control information describing a 
data traversal process; 

75 second processor means responsive to said first 
processor means for transforming said second set 
of control information into detailed graphics orders 
based on said first set of control information; 
third processor means for transforming said de- 

20 tailed graphics orders into signals representing dis- 
playable points on a display device; and 
display generation means for generating a display 
on said display device in response to said signals. 
There has been described, therefore, a general 

25 purpose interface between a general purpose sys- 
tem control processor and a specialized graphics 
processor. 

This general interface structure is efficient to 
update from the general purpose computer proces- 
30 sor as well as efficient to process from the special- 
ized graphics processor viewpoint. 

A specific division of processing workload be- 
tween a system control processor and graphics 
command processor is described, this being co- 
35 ordinated through a set of specified control blocks. 
However it will be recognized by those practicing 
in the graphics display system area that the con- 
cept of the general purpose control processor com- 
municating with special purpose processors can be 
40 extended beyond the single graphics command 
processor interface. All extensions of this sort are 
believed to be extensions of the concepts dis- 
closed herein. 

45 

Claims 

1 . A graphics display system for displaying graph- 
ics objects defined by a hierarchical data structure, 

so said system comprising: 

first processor means for transforming said hierar- 
chical data structure into a first set of control in- 
formation defining a workstation environment and a 
second set of control information defining a data 

55 traversal process; 

second processor means responsive to said first 
processor means for tranversing said second set of 
control information for generating graphics orders 
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based on said first and second sets of control 
information; 

and means for displaying said graphics objects in 
response to said graphics orders. 

2. A graphics display systme as claimed in claim 1 
wherein said means for displaying comprises: 
third processor means for transforming said de- 
tailed graphics orders into signals representing dis- 
playable points on a display device; and 

display generation means for generating a display 
on said display device in response to said signals. 

3. A graphics display system as claimed in claim 1 
or claim 2 wherein said first processor means is a 
general purpose system control processor and 
wherein said second processor means is a special 
purpose graphics processor. 

4. A graphics display system as claimed in any 
preceding claim wherein the first set of control 
information comprises one or more of the following 
items: workstation flags, view table indicators, bun- 
dle table settings, pattern table settings, filter table 
settings, input device descriptions, traversal pro- 
cess status flags, wherein said second set of con- 
trol information comprises descriptions of views, 
structures, and edit blocks and wherein said sec- 
ond processor means: 

accesses said first set of control information to 
determine a view table to begin traversal process- 
ing; 

tests a description of views associated with said 
view table to determine whether to begin traversing 
said view and accessing a subsequent view if tra- 
versing for said view has been completed; and 
modifies said description of views as traversal of 
each view is completed to indicate completed tra- 
versal; and 

modifies said description of views after all views 
have been completed to reset an indicator to in- 
dicate traversal is required. 

5. A graphics display system as claimed in claim 4 
wherein said second processor means is operable: 
to interrupt said traversal; 

to modify said first or second set of information; 
and 

to resume said traversal after testing said first set 
of control information so that any modified view is 
retraversed 

6. A method, in a graphics display system, for 
traversing a hierarchical data structure defining 
graphics objects to generate a display of the 
graphics objects, the method comprising the steps 
of: 

separating, by means of a first processor, said 
hierarchical data structure into a first set of work- 
station control information and a second set of 
traversal control information; 

signalling the beginning of data structure traversal; 
and 



traversing, by means of a second processor, said 
second set of control information and generating 
graphics orders based on said first and second 
sets of control information, said graphics orders 
5 being transmitted to means for displaying said 
graphics objects. 

7. The method of claim 6 wherein said first set of 
workstation control information comprises one or 
more of the following items: workstation flags; view 

10 table indicators; bundle table settings; pattern table 
settings; filter table settings; input device descrip- 
tions and traversal process status flags; wherein 
said second set of traversal control information 
comprises descriptions of views, structures, and 

15 edit blocks and wherein said method further com- 
prises the steps of: 

accessing said first set of control information to 
determine a view table to begin traversal process- 
ing; 

20 testing said description of views associated with 
said view table to determine whether to begin tra- 
versing said view and accessing a subsequent view 
if traversing for said view has been completed; 
modifying said description of views as traversal of 

25 each view is completed to indicate completed tra- 
versal; and 

modifying said description of views after all views 
have been completed to reset an indicator to in- 
dicate traversal is required. 
30 8. The method of claim 7 further comprising the 
steps of: 

interrupting said traversal, 

modifying said first or second set of information; 
and 

35 resuming said traversal after testing said first set of 
control information so that any modified view is 
retraversed and any unmodified view is not re- 
traversed. 

40 
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